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ABSTRACT 

We  analyze  the  performance  of  a  tandem  queueing  network  populated  by  two  customer  types. 
The  interarrival  times  of  each  type  and  the  service  times  of  each  type  at  each  station  are 
independent  random  variables  with  general  distributions.  A  setup  time  is  incurred  when  a 
server  switches  from  one  customer  type  to  the  other,  and  each  server  employ's  an  exhausti\e 
polling  scheme.  We  assume  that  the  load  on  each  station  is  identical,  and  employ  heavy  traffic 
approximations  to  compute  the  sojourn  time  distribution  for  a  customer  that  arrives  to  find  the 
network  in  a  particular  state.  When  .setup  times  ai^e  zero  (except  perhaps  at  the  first  station) 
and  additional  "product-form"  type  assumptions  are  imposed,  we  find  the  steady  state  sojourn 
time  distribution  for  each  customer  type. 
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We  consider  a  tandem  queueing  system  with  /\  single-server  stations.  Customers  of  two 
types,  denoted  by  .4  and  B,  arrive  to  station  1  according  to  independent  renewal  processes. 
Each  customer  is  served  once  at  each  station,  and  customers  exit  after  being  served  at  station 
A'.  Although  each  customer  type  has  its  own  general  service  time  distribution  at  each  station, 
we  require  the  load  on  each  station  to  be  identical.  A  setup  (or  switchover)  time  is  incurred 
at  each  station  whenever  a  server  switches  from  serving  one  customer  type  to  the  other.  We 
assume  that  each  server  employs  an  exhaustive  polling  scheme:  Serve  all  customers  of  the  type 
that  is  currently  set  up;  when  there  are  no  more  of  these  customers  in  queue,  switch  to  the 
other  customer  type  and  serve  all  of  its  customers  exhaustively. 

Our  goal  is  to  derive  the  sojourn  time  distribution  for  each  customer  type  in  both  the 
transient  and  steady  state  cases.  In  the  transient  case,  we  attempt  to  find  the  sojourn  time  of  a 
customer  who  arrives  to  the  network  and  finds  it  in  a  particular  state  (described,  for  example, 
by  the  2A'-dimensional  queue  length  process  and  the  location  of  each  server).  Hence,  in  contrast 
to  steady  state  performance  analysis,  where  unconditioned  or  conditioned  sojourn  times  can  be 
considered,  the  transient  sojourn  time  distribution  we  compute  is  conditioned  on  the  state,  and 
hence  is  state-dependent. 

The  motivation  for  studying  this  problem  comes  from  manufacturing  systems.  Although 
queueing  network  models  for  manufacturing  typically  do  not  include  setup  times,  many  factories 
incur  significant  setup  times  and/or  setup  costs  (the  recent  trend  is  to  reduce  setup  times  at 
the  expense  of  large  material,  equipment  and/or  labor  costs)  when  a  machine  switches  from 
producing  one  type  of  product  to  another.  To  exploit  these  economies  of  scale,  manufacturers 
are  forced  to  produce  their  products  in  large  batches,  and  the  exhaustive  policy  considered  here 
is  the  most  natural  way  to  reduce  setups  without  incurring  unnecessary  idleness. 

In  manufacturing  settings,  sojourn  time  (also  called  manufacturing  cycle  time,  lead  time 
or  throughput  time)  distributions  help  managers  to  release  and  schedule  work,  quote  delivery 
dates  for  customers,  coordinate  with  downstream  operations  (such  as  distribution),  price  their 
products  and  set  performance  metrics.  Steady  state  sojotun  times  are  helpful  for  tactical  and 
strategic  level  decisions,  and  are  the  best  available  estimates  for  factories  that  cannot  generate 
real  time  queue  length  information.  For  systems  with  real  time  information  capability,  transient 
sojourn  times  are  preferable  to  steady  state  estimates  for  operational  decisions,  and  can  greatly 
enhance  performance  (see  Wein  1991  for  a  simple  example  in  due-date  cjuotation). 

Our  queueing  network  model  is  essentially  a  set  of  polling  systems  in  tandem.    Although 
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the  performance  analysis  of  polling  systems  has  generated  an  enormous  literature,  there  are  no 
studies  that  consider  a  network  of  interacting  polling  systems.  Karmarkar  et  al.  (1985)  develop 
a  fixed  batch  size  queueing  network  approximation  that  is  useful  for  tactical  level  decisions, 
but  they  do  not  capture  the  detailed  system  dynamics  of  the  network.  Since  our  queueing  net- 
work model  appears  to  defy  exact  analysis,  we  employ  heavy  traffic  approximations  to  address 
the  problem.  Recently,  Coffman,  Puhalskii,  and  Reiman  (1995a,  1995b)  —  henceforth  referred 
to  as  CPRI  and  CPRII,  derived  an  averaging  principle  for  single-server  polling  systems  with 
and  without  switchover  times.  This  principle  is  due  to  a  time  scale  decomposition  that  arises 
under  the  traditional  heavy  traffic  normalizations:  On  the  time  scale  giving  rise  to  a  diffusion 
process  for  the  total  workload,  the  individual  workloads  (for  each  class)  move  (asymptotically) 
infinitely  fast.  When  viewed  on  the  time  scale  that  makes  the  rate  of  movement  of  the  indi- 
vidual workloads  positive  and  finite,  the  total  workload  remains  constant,  and  the  individual 
workloads  move  deterniinistically.  Consequently,  the  dynamics  of  thc^  individual  workloads  can 
be  analyzed  deterministically.  The  primary  contribution  of  this  paper  is  the  deterministic  anal- 
ysis of  the  individual  workloads  for  a  tandem  queueing  system.  This  deterministic  analysis 
yields  a  recursive  procedure  for  the  transient  sojourn  time  distribution  of  each  customer  type 
for  the  system  described  at  the  beginning  of  this  paper.  To  perform  a  steady  state  sojourn  time 
analysis,  the  stationary  tlistribution  of  the  vector  describing  the  total  workload  at  each  station 
is  required.  We  compute  the  steady  state  .sojourn  time  distribution  by  making  the  additional 
assumptions  that  setup  times  are  zero  and  that  the  total  workload  vector  has  a  product-form 
distribution  (product-form  conditions  for  an  approximating  Brownian  network  are  slightly  less 
restrictive  than  the  corresponding  conditions  for  a  traditional  queueing  network).  In  addition, 
we  derive  a  product-form  solution  in  heavy  traffic  for  the  case  where  only  the  first  station  has 
setup  times. 

The  remainder  of  this  paper  is  organized  as  follows.  The  model  is  formulated  in  Section 
1  and  the  heavy  traffic  normalizations  are  introduced  in  Section  2.  Section  3  contains  the 
deterministic  analysis  that  forms  the  basis  of  this  paper;  to  keep  the  analysis  relatively  easy 
to  follow,  we  restrict  ourselves  in  this  section  to  the  case  where  all  service  time  distributions 
have  the  same  mean.  The  deterministic  results  are  used  in  Section  4  to  obtain  the  transient 
and  steady  state  sojourn  time  distributions  for  the  original  queueing  network.  For  several 
simple  examples,  we  also  compare  our  steady  state  sojourn  time  estimates  to  those  computed 
via  simulation.    In  Section  5,  we  investigate  several  generalizations  of  the  model,  including 


service  rates  that  differ  by  customer  type  at  each  station,  closed  networks,  networks  with  three 
customer  types,  the  incorporation  of  FCFS  nodes,  and  setup  times  at  station  1.  Conchiding 
remarks  are  offered  in  Section  6. 

1      The  Model 

The  queueing  network  ha.s  A'  single-server  stations  and  two  customer  types,  A  and  B. 
Customers  of  each  type  arrive  to  station  1  according  to  independent  renewal  processes  with 
rates  A^  and  A^,  proceed  through  the  tandem  network  from  station  1  to  station  A',  and  exit 
after  service  is  completed  at  station  A".  Following  traditional  terminology,  we  define  a  different 
class  of  customer  for  each  stage  of  each  type's  route;  these  classes  are  denoted  by  Ai  and  Bi  for 
i  =  1  . . .  ,  K.  Each  class  has  a  different  general  service  time  distribution,  but  all  service  rates 
equal  /.i.  Let  pj  =  \j/p  for  j  =  .4,  B,  and  define  the  traffic  intensity  of  tliis  balanced  system  by 
p  =  Pa  +  PB-  Finally,  let  cJq  denote  the  scjuared  coefficient  of  variation  of  the  interarrival  times 
for  type  j  and  let  c~,  represent  the  squared  coefficient  of  \-ariation  of  the  service  times  for  class 

We  assume  that  a  random  setup  time  is  incurred  when  a  server  switches  from  one  class  to 
the  other;  however,  due  to  the  scaling  of  time  and  the  rarity  of  switchovers  in  heavy  traffic, 
our  transient  sojourn  time  estimates  are  independent  of  the  setup  time.  Consequently,  we  do 
not  introduce  any  setup  time  notation.  Finally,  the  server  at  each  station  serves  each  class  to 
exhaustion,  and  then  switches  to  the  other  class. 

2     Heavy  Traffic  Preliminaries 

In  a  typical  heavy  traffic  analysis,  one  defines  a  sequence  of  queueing  systems  indexed  by  n 
that  approaches  heavy  traffic  as  n  —>  oc.  Since  a  heavy  traffic  limit  theorem  will  not  be  derived, 
we  avoid  unnecessary  notation  by  considering  a  single  large  integer  n  satisfying  \/n{p  —  1)  =  c, 
where  c  is  negative  and  of  moderate  size.  This  condition  requires  each  server  to  be  busy  the 
great  majority  of  the  t'nnc  to  satisfy  demand.  In  Section  4,  we  see  that  our  sojourn  time 
estimates  are  independent  of  the  system  parameter  n. 

For  class  ji,j   =  A,B:)   =   1 A',  let  {Lj,{t),f   >  0}  denote  the  unfinished  workload 

process  and  {M'j,(f),  t  >  0}  be  the  viytiiRl  wniting  time  process.  The  quantity  L_,j(<)  denotes  the 
remaining  work  for  the  server  at  station  ;  embodied  in  class  ji  customers  at  time  t,  and  Wj,{t)  is 
the  waiting  time  experienced  at  station  i  by  a  type  j  customer  arriving  to  the  network  at  time  /. 


Using  the  standard  heavy  traffic  scaling,  we  define  the  normalized  processes  Vji{t)  =  Lj,{nt)/y/n 
and  Zj,(i)  =  Wj,{nt)/,/n.  Finally,  let  V';(0  =  VA,{t)  +  V'e,(0  denote  the  normalized  workload 
at  station  i  at  time  t. 

CPRI  and  CPR  II  perform  a  heavy  traffic  analysis  of  a  single-server,  multiclass  queue  that 
employs  exhaustive  polling.  Their  results  imply  that  for  any  bounded  continuous  function  / 
and  any  7"  >  0, 

/    f(Vji{t))dt    is  well  approximated  by     /     (/    f{uVi{t))du)dt,    j=A,B.  (2.1) 

Jo  Jo     Jo 

This  heavy  traffic  averaging  principle  reveals  a  time  scale  decomposition  of  the  total  workload 
\'i  and  the  individual  workloads  V,\i  and  \'b]-  The  one-dimensional  total  workload  V'l  varies  as 
a  diffusion  process  (a  Bessel  process  if  setup  times  are  positive  and  a  reflected  Brownian  motion 
if  setup  times  are  zero),  whereas  the  two-dimensional  process  (V'41 ,  V/ji )  moves  infinitely  (}uickly 
in  the  heavy  traffic  limit.  If  time  is  slowed  down  by  a  factor  of  y/n.  so  that  the  two-dimensional 
workload  moves  at  a  finite  and  positive  rate,  then  the  total  workload  \\  remains  constant  and 
the  movement  of  the  two-dimensional  workload  process  is  deterministic.  Moreover,  the  setup 
times  do  not  affect  the  deterministic  movement  of  the  normalized  two-dimensional  process, 
CPRI  and  CPR  II  also  use  (2,1)  to  derive  an  averaging  principle  for  virtual  waiting  times  in  a 
single-server  polling  system,  which  implies  that 

/    f{Zjiit))dt    is  well  approximated  by     /   (/   f  l^^^^\  du)dt,    j  =  A,D.         (2.2) 

In  this  paper,  we  a.ssume  that  the  workload  averaging  principle  (2.1)  holds  not  just  for 
station  1,  but  for  each  station  i  =  1, . . .  ,  A'  in  the  tandem  network.  We  also  assume  that  the 
snapshot  principle  holds;  this  principle,  which  was  first  observed  by  Foschini  (1980)  and  proved 
by  Reiman  (1984)  in  the  context  of  a  single  class  queueing  network,  asserts  that  in  the  limiting 

heavy  traffic  time  .>cale,  the  vector  of  total  workloads  (\'i l'/^)  does  not  change  during  a 

customer's  sojourn  in  the  network.  I'nder  these  assumptions,  we  undertake  in  the  next  section  a 
deterministic  analysis  of  the  2A'-dimensional  nornudized  workload  process.  This  analysis  yields 

the  distribution  of  the  normalized  virtual  waiting  time  Zj,.j  -  A.B.i  —  1 A',  given  the 

constant  workload  vector  (V'l, \\).   As  is  typical  in  heavy  traffic  systems,  if  we  let  \Vp{i) 

denote  the  actual  waiting  time  at  station  (  of  the  first  type  7  customer  to  arrive  to  the  system 
after  time  /,  then  \Vjt{nt)ls/n  converges  together  with  the  norniHlized  virtual  waiting  time 
process  \Vj,{nt)/ y/n. 


In  order  to  carry  out  a  steady  state  analysis  of  sojourn  times,  we  need  the  steady  state 

distribution  of  tlie  vector  of  total  workloads  (V'l 1)^. ).  There  is  no  rigorous  treatment  of  the 

behavior  of  the  vector  total  workload  process  {{\'\{t) l'i-(O)- '  >  *J}  i"  heavy  trafhc  under 

the  a-ssmnption  that  the  service  time  distribution  of  a  customer  at  a  given  station  depends 
on  its  type.  If  setup  times  are  zero  and  the  service  time  distributions  de{)end  onl\-  on  the 
station,  then  the  heavy  traffic  limit  theorem  in  Reiman  (1984)  can  be  applied.  Under  the  FCFS 
discipline  (with  no  setup  times),  the  heavy  traffic  limit  theorem  in  Peterson  (1991)  covers  our 
assumption  in  the  sense  that  service  time  distributions  are  allowed  to  depend  on  both  station 
and  type.  The  insult  in  Peterson  does  not  directly  apply  to  our  case  because  the  total  workload 
in  station  A-  >  1  under  exhaustive  polling  may  not  be  the  same  as  under  FCFS.  (With  no  setup 
times,  the  total  workload  in  station  1  is  the  same  under  both  disciplines.)  It  .seems  clear  from 
heavy-traffic  scaling  arguments  that  the  heavy  traffic  limit  of  the  vector  total  workload  process 
(with  zero  setup  times)  is  the  same  under  exhaustive  polling  as  in  FCFS  a.s  long  as  the  mean 
service  time  depends  only  on  the  station.  Thus  we  use  the  results  of  Peterson  even  though 
there  is  no  rigorous  proof  that  they  apply  (unless  the  service  time  distribution  depends  only  on 
the  station).  The  heavy  traffic  scaling  argument  is  roughly  as  follows.  The  drift  of  the  limit 
diffusion  process  depends  only  on  arrival  rates  and  mean  service  times,  so  it  is  the  same  in 
both  cases.  The  variance  of  the  limit  diffusion  process  depends  on  variation  in  the  centered  and 
normahzed  processes  over  0{n)  time;  on  this  scale,  based  on  results  in  CPRI  and  CPRII.  the 
fraction  of  each  type  served  is  the  same  as  m  FCFS,  so  the  variances  should  match.  Although 
the  stationary  distribution  of  the  limit  diffusion  process  is  not  known  in  general,  Peterson  has 
identified  cases  under  which  the  stationary  distribution  is  a  product  of  exponential  marginals. 
When  this  condition  is  not  met,  the  numerical  procedure  of  Dai  and  Harrison  (1992)  can  be 
used. 

3      Deterministic  Analysis 

Throughout  this  section,  we  slow  down  time  so  that  the  total  workload  vector  (\'i I'k) 

is  fixed,  and  {Vj,(/),f  >  0},j  =  A,D:i  =  1 K  moves  at  a  finite  rate  in  a  deterministic 

fashion.  If  we  denote  the  arrival  time  of  a  randomly  arriving  customer  as  time  0,  then  the  initial 

conditions  are  random,  and  consist  of  \'j,{0).j  =  A.B.i  =  1 A'  and  .s,(0),(  =  1 A'. 

where  Va,{0)  +  \'[u(0)  —  \',  and  .s,(/)  is  the  customer  type  being  served  by  .server  i  at  time  f. 
Hence,  the  deterministic  path  of  {\'j,{t).t  >  0}  is  dictated  by  \',4/(0),  ,s;(0),/  =  1 /;  as  we 


will  see  shortly,  it  suffices  to  focus  on  VAi{t),  i  =  1, A',  because  V/t,(0  +  ^Bi(0  is  equal  to 

V;  for  all  t. 

The  derivation  of  our  main  result  consists  of  three  main  steps:  First,  we  show  that,  inde- 
pendent of  initial  conditions,  the  process  {V4,(<),f  >  0}  enters  a  unique  limit  cycle  within  a 
finite  amount  of  time;  that  is.  the  trajectory  of  the  process  keeps  repeating  the  same  cycle. 
Second,  we  identify  the  limit  cycle  for  station  ?.  The  cycle  consists  of  the  service  of  class  Ai 
customers  for  C4,  time  units  followed  by  the  service  of  class  Di  customers  for  C/j,  time  unitr. 
and  the  cycle  repeats  itself  every  C,  =  CAi  +  Cbi  time  units;  we  refer  to  C,  as  the  cycle  length 
for  station  i,  and  refer  to  Cj,  as  the  cycle  length  for  class  ji.  Finally,  we  derive  the  normalized 
virtual  waiting  time  from  the  limit  cycle. 

Before  stating  the  main  result,  we  illustrate  our  method  on  the  single-server  polling  model  in 

CPRI  and  CPRII,  and  th(Mi  informally  describe  'he  dynamics  of  VjAO^J  =  A.  B\i  =  \ K 

for  a  fixed  total  workload  vector  (I'l, . . . ,  \X-).  Since  arrivals  to  station  1  are  exogenous,  class 

.41  work  arrives  to  station  1  at  rate  p^.  regardless  of  the  system  state.    The  server  depletes 

work  at  rate  one,  and  hence  V'4i(f)  decreases  at  rate  1  —  pa  when  class  .41  is  being  served,  and 

increases  at  rate  pA  otherwi.se.  Because  p  =  1  in  the  heavy  traffic  limit,  we  assume  that  \'.\i(0 

increases  at  rate  1  —  pg,  rather  than  pa,  when  class  Bl  is  being  served.    Since  setup  times 

do  not  appear  at  this  time  scale  in  the  heavy  traffic  limit.  {VAi{t),t  >  0}  follows  the  familiar 

"saw-tooth"  path  that  arises  in  the  economic  order  quantity  model  with  finite  production  rate: 

see  the  top  graph  in  Figure  1.    Hence,  regardless  of  the  initial  conditions  (^41(0),  .si(0)).  the 

process  {VAi{t),t  >  0}  essentially  enters  a  limit  cycle  at  time  zero.   However,  for  convenience 

and  without  loss  of  generality,  we  specify  the  start  of  a  cycle  as  the  moment  that  V^i  (<)  increases 

from  zero.   If  fi  denotes  the  starting  time  of  the  first  cycle  at  station  1  {ti  =  10  in  Figure  1), 

then 

VAi(t)  =  {\-puXt-h)    for    fG[fi,f,  +  — ^]  (3.1) 

1  -  Pb 

and 

,  , _  V^i  r_  \',        _  \',  \\     1 

(3.2) 


VAiit)  =  \\  -  {I  -  PA)(t  ~  ih  +  ^-^))    for   ^€ 

1  -  PB 


1  -  pf)  i  -  PH       1  -  Pa. 

Class  Bl  customers  are  served  during  the  interval  described  in  (3.1)  and  class  .41  customers 
are  served  in  (3.2).  It  follows  that 

(-/U  =  :; .       Cb\  = and      Ci  =  ; h  :; .  (3.3) 

^  -  Pa  I  -  Pb  I  -  Pa       I  -  Pb 


Therefore,  V'4i(0  =  0  for  t  =  h  +  j^  +  j^  =  32  and  the  cycle  in  (3.1)-(3.2)  repeats  itself 
at  this  time. 


VaoU 


22  32  36       44         54 


66         76  88         98102     llO       120 


Figure  1:  The  workload  process  dynamics  for  an  example:  A^  =  0.4,  As  =  0.5, /x  =  1, 
Vai{0)  =  6,  Vbi(0)  =  0,  V:42(0)  =  16,  VbiW  =  0  and  si(0)  =  S2(0)  =  A. 


Now  we  use  the  limit  cycle  (3.1)-(3.2)  to  derive  the  normalized  virtual  waiting  time  Z ,\\ 
conditioned  on  \'i.    If  a  type  A  customer  arrives  at  time  t  e  [f]  +  .y*    Ji  + 


i-ps'''    '    i-PB        i-p.iJ' 
then  class  .41  customers  are  being  served,  and  Z.41  ecjuals  the  class  .41  workload  at  time  t,  or 


V'l  —  (1  —  p.4)(f  —  (^1  +  ^_'    )).  A  type  .4  customer  arriving  at  time  f  G  [f  1,  f  1  + 


I-PB 


must  wait 


^1  +  "i — ' t  time  units  until  all  class  Bl  customers  are  served,  and  then  wait  an  additional 

^'41(0  =  (1  ""  PB)(i  —  h)  time  units  for  the  class  .41  customers  in  front  of  him  to  be  served. 
A  'randomly'  arriving  customer  will  arrive  at  a  point  in  time  that  is  uniformly  distributed 
throughout  the  limit  cycle  (that  is,  uniformly  distributed  on  [tiJ\  +  j^, — ^"  ]!'  ])■  Hence,  if 
we  let  U  denote  a  uniform  random  variable  on  [0, 1]  and  again  assume  that  pA  +  Pb  =  ^-  then 

f^^V'i  with  probability    p.4; 

UV\  +  ^  ~_  '  '      with  probability    pg; 

and  hence 


'.41 


(3.4) 


Zai    is  uniformly  distributed  on 


0, 


PAi 


(3.5) 


This  result  can  be  derived  directly  from  the  averaging  principle  of  CPRI  and  CPRII  for  virtual 
waiting  times  by  setting  V\{t)  -  \\  for  all  t  and  letting  /(.r)  =  /{x<.-}  '"  (2-2);  a  similar  analysis 
implies  that 


0, 


V, 


PBi 


(3.6) 


Zbi    is  uniformly  distributed  on 

We  know  that  E[Zji]  should  equal  \\  if  p,\  =  pn.  To  maintain  consistency  with  this  fact  when 
p  <  1,  let  us  refine  (3.5)-(3.6)  to 

Wp 


Zj\    is  uniformly  distributed  on 


0, 


Pj 


for   ;  =  A.B. 


(3.7) 


Stations  2 A'  Ijehave  in  a  fundamentally  different  way  than  station  1,  and  consequently 

the  averaging  principle  for  virtual  waiting  times  (2.2)  does  not  hold  for  the  downstream  stations. 
In  particular,  rather  than  receiving  steady  streams  of  both  types  of  customers,  downstream 
stations  receive  aiternat/ng  streams  of  type  A  and  type  B  customers.  As  mentioned  earliei .  the 
actual  timing  of  the  arrival  streams  of  cla^sses  .4, ;  +  1  and  B.  i  +  I  to  station  i  +  1  is  dictated 
by  the  dynamic  location  of  the  server  at  station  /. 

Let  us  consider  the  behavior  of  {l..i2(')-'  ^  0},  which  is  influenced  by  the  locations  of 
servers  1  and  2.  If  .si(0  =  ••!  then  class  .42's  queiie  is  receiving  work  from  station  1  at  rate  one, 
and  if  S2{t)  =  A  then  class  ,42\s  work  is  being  depleted  at  rate  1.  Hence,  if  si{t)  =  S2it)  =  A 
or  S](t)  =  S2(0  =  B.  then  \'A2{t)  remains  constant;  if  .si(^)  —  A  and  .S2(/)  =  B  then  \'A2i^) 
increases  at  rate  one,  and  if  .si(/)  =  B  and  S2{t)  =  .4  then  V'42(0  decrea.ses  at  rate  one. 
Moreover,  V^2(0  +  Vb2(0  =  ^''  for  all  f  >  0. 

We  are  now  ready  to  state  and  prove  our  main  result.  Let  us  define 


"Bi  = 


C.4, 


»A,  = 


iv> 


+  1 


Cb, 


and     n,  =  tiA,  +  n^t     for     ;  =  1, 


1. 


(3.8) 


Theorem  1.    Fix  (V'l, . . . ,  V'v)-  Then  for  i  =  I. 


Ca,i+\  =  (";  -  1)Ca,,      Ci3,,+i  =  {n,  -  1)Cb,     and     C,+i  =  (n,  -  1)C,; 


(3.9) 


and 


Za,i+\  = 


Zb.i+\  = 


V',  +  1  +  jCbi     with  probability    ^^-^-j-    for   j  =  0, . . . ,  n/j,  -  1: 
V',+1  -  jCsi-,     with  probability    ^^^    for   j  =  1, . . .  ,n.4,  -  1; 


V',+1  +  jCax-     with  probability    j^-^y    for  j  =  0, 
V,  +  \-jCa,-     with  probability    ^^-^    for  j  =  1, 


,?),4,  -  1: 
•  niii  -  1- 


(3.10) 


(3.11) 


Proof.  The  proof  is  by  induction  on  i.  Let  us  first  focus  on  deriving  tlie  wortcload  (unfinished 
work)  at  station  2.  Our  first  step  is  to  show  that  the  process  {V,.v2(0'  f  ^  0}  enters  a  hniit  cycle 
within  a  finite  amount  of  time.  Without  loss  of  generality,  we  define  the  first  cycle  at  station  2 
to  begin  at  time  (2  —  'n\i{t  >  0  :  r4i(0  =  V'l,  V'42(0  =0}.  At  time  ^2.  ^hc  server  at  station  1 
switches  from  class  Bl  to  class  .41.  Since  V'.i2(^2)  =  0,  the  s(>rver  at  station  2  will  be  serving 
class  52  just  after  time  to  (and  perhaps  just  before  time  ^2  also);  hence,  V'42(0  increases  at 
rate  1  starting  at  time  f2- 

Since  V'l  and  V2  are  fixed,  the  deterministic  process  {V/i2(0.^  >  0}  is  fully  specified  by  the 
initial  conditions  ( V'.\i(0),  V'42(0),  ,si  (0),  .§2(0)).  We  now  compute  ^2  foi"  fhe  four  cases  charac- 
terized by  the  values  of  (.s-i(O),  S2(0)).  If  .si(0)  =  .S2(0)  =  .4,  then  V;42(/)  stays  constant  for  the 
first  y^_-  time  units.  Thereafter,  until  V'42(0  reaches  zero,  it  alternates  between  decreasing 
at  rate  1  for  Cb\  time  units  and  staying  constant  for  C41  time  units,  and 


f2  =   Z + 

1  -  Pa 


V42(Q) 

Cbi 


Cb\  + 


v;42(o) 

c 


B\ 


1   c. 


.41- 


(3.12 


readers  are  referred  to  the  bottom  graph  in  Figure  1,  where  t^  =  44. 

If  5i(0)  =  52(0)  =  B.  then  after  remaining  constant  for  ^^'^  '  time  units,  V',42(0  rises  and 
stays  constant  during  ^^^  periods  of  length  C41  and  ^^^  '  —  1  periods  of  length  Cb]  • 
respectively.  At  this  point  V'42(0  =  Vo,  .si(0  =  B,  and  .S2(0  =  ■■^-  then  the  process  V'42(0 
alternates  between  decreasing  and  constant  phases  until  ^2^  where 


r  Vbi(0)     , 

t2  =  :; 1- 

1  -  PB 


Vb2{0) 

c 


A\ 


Cai  + 


VbtW 
C 


.41 


l|Cs,+ 


\. 


\'>  1 


C 


Bl 


c 


B\ 


^2 

C7i 


1    c 


(3.13) 


If  .si(0)  =  .4  and  .^2(0)  =  B,  then  \'.42(0  grows  initially.  Before  reaching  t-i,  it  must  rise  by 

Vb2{0)  and  then  drop  to  zero.  The  length  of  the  first  growth  period  (which  starts  at  time  zero) 

for  V'42  is    ^^'^  '  A  V'/^2(0)^  and  the  length  of  any  subsequent  growth  periods  (there  are  none 

if  ^B2(0)  <    /'  ■  ' )  is  C'ai-   Once  \'.42(0  starts  decreasing,  it  proceeds  as  in  the  previous  case. 
^    Pa 

Hence, 


^; 


V:4i(0) 
1  -Pa 


+ 


Vb2(0)  -  t^ 
Cm 


^'^{Vb.(0)>^}  + 


V? 


C 


fli 


Cbi  + 


Vi 


C 


B\ 


1     C.4,  ,   (3.14) 


where  /|jj  is  the  indicator  function  for  the  event  .r.  Sinularly,  if  .si(0)  =  B  and  •S2(0)  =  .4.  then 


12  =  :; H 

1  -  PB 


Va2{0) 


Vbi(0) 

1-PB 


Cbi 


CJ.v 


Mr  I'bi(O) 


,^<V^2(0)}- 


(3.15) 


Now  we  look  at  the  evolution  of  V^2(0  during  the  first  full  cycle,  which  starts  at  time 
^2.  Readers  are  referred  to  1^2(0  for  t  €  [44,110]  in  Figure  1.  The  process  VA2{t)  initially 
alternates  between  tibx  -  1  (possibly  zero)  growth  periods  of  length  Cai  and  constant  periods 
(that  is,  time  intervals  where  \'A2{t)  remains  constant)  of  length  C«i,  as  described  by 

VA2{t)  =  U  -  1)Cai  +  t  -  {h  +  (;  -  l)Ci)   for  t  e  [h  +  U  -  l)Ci ,  h  +  (;  -  l)C,  +  Cai]  (3.16) 

and 

VA2{t)=]CAx    for   te[i2  +  {j-\)Cy-^CAxJ2  +  ]Cx]  (3.17) 

for  j  =  1, . . .  ,nfli  —  1.  The  last  growth  period,  which  is  given  by 

VA2{i)  =  {riBi  -  l)C.u  +  f  -  ih  +  (nsi  -  1)C,) 

for    /  G  [^2  +  (hb,  -  l)Cut2  +  (n«i  -  l)Ci  +  Vo  -  (ngi  -  l)C4i],  (3.18) 

is  truncated  when  \'A2{t)  reaches  its  maximum  value  of  V2;  at  this  point,  the  process  remains 
constant  until  server  1  exhausts  the  class  Al  customers  in  queue: 

^42(0  =  V2    for   t  e  [h  +  (nei  -  1)C,  +  V2  -  (ubi  -  1)CaiJ2  +  ("bi  -  1)C,  +  Cai]-    (3.19) 

The  process  then  alternates  between  hai  -  1  depletion  intervals  of  length  Cb\  and  constant 
intervals  of  length  Cai.  given  by 

VA2{t)  =  V2  -  U  -  l)Ce,  -[t-  {I,  +  {nBi  +  J  -  2)C,  +  C..U )] 

for    t  e  [h  +  (nai  +  j  -  2)Ci  +  CA1J2  +  ("31  +  j  -  l)Ci]  (3.20) 

and 

VA2{t)  =  V2  -  jCbx    for    t  G  [h  +  {hbi  +j-l)Ci,i2  +  {'iBi  +j-l)Ci+  Cai]         (3.21) 

for  j  =  1 TiAi  -  1.  Once  again,  the  last  depletion  cycle 

VA2{t)  =  V2  -  (n.-u  -  DCfl,  -[t-  ih  +  {iiAi  +  n/ii  -  2)Ci  +  Cax)] 

for  te[i2  +  {nBi+nAi-2)Ci+CAi,i2  +  {nAi+nBi-2)Ci+CAi  +  V2-{nAi-'^)CBi]  (3.22) 

is  truncated  when  V'^v2(0  reaches  zero,  and  the  linut  cycle  concludes  when  server  1  completes 
serving  the  class  Bl  customers  in  queue: 

VA2(t)  =  0  for  /  e  [f2  +  (".u+"«i-2)C,+Cu+V'2-(n,u-l)CBi,r2  +  (7!..u+»/?i-l)C,].   (3.23) 


Notice  that  at  time  ^2  +  (".-ii  +  "fii  ~  l)C'i,  the  system  state  iVy\i{t),VA2{t),s\{t),S2{t))  is 
the  same  as  at  time  to-  Hence,  the  system  repeats  the  same  cycle  of  length  (/'i  —  1  )Ci  thereafter. 
Class  ,42  is  served  in  (3.19)-(3.22)  ^uld  class  B2  is  served  in  (3.16)-(3.18)  and  (3.23).  Therefore, 
classes  .42  and  B'2  are  served  in  contiguous  time  blocks  of  length  {riy  -  l)C.u  and  {iii  —  l)C'ai, 
respectively,  and  (3.9)  holds  for  i  =  1. 

To  calculate  the  virtual  waiting  time  for  class  .42,  notice  that  type  .4  customers  only  arrive 
to  station  2  when  class  .41  customers  are  being  served.  These  time  intervals  correspond  to 
the  7)01  —  1  growth  periods  in  (3.16),  the  truncated  growth  interval  (3.18)  and  its  subsequent 
constant  period  (3.19),  and  the  n^}  —  1  constant  intervals  dining  V',v2(0's  descent  in  (3.21).  If 
we  view  (3.18)  and  (3.19)  together  as  one  interval,  rhen  all  ni  -  1  intervals  are  of  length  Ca\\ 
a  randomly  arriving  class  .42  customer  is  ecjually  likely  to  arrive  dining  each  of  these  intervals. 

A  class  .42  customer  arriving  during  the  constant  periods  in  (3.21)  finds  the  server  serving 
type  .42  customers,  and  hence  the  virtual  waiting  time  there  is  given  b)'  \'A2{t)-    Therefore, 

Z.42  =  Vo  —  jC'bi  with  probability  (nj  —  1)~'  for  j  =  1 /741  —  1.    A  class  .42  customer 

arriving  at  time  t  during  (3.16)  must  wait  until  time  t>  +  (n bi  —  l)C'i  +  lo  —  (''si  —  l)C.ii- 
at  which  point  class  .42  begins  exhaustive  service,  plus  an  additional  V'.i^O  time  units  for 
the  class  .42  customers  ahead  of  him  to  be  served.  Therefore,  the  virtual  waiting  time  equals 
V'42(0  +  ^2  +  ^2  +  ("SI  -  l)(^Bi  -  '■  Substituting  1^2(0  from  (3.16)  into  this  expression  gives 
Z.42  =  ^2  +  ["01  —  j](^'bi-  which  occurs  with  probability  (iii  -  1)"^  for  j  —  l....,;)si  —  1- 
Similarly,  class  .42  customers  arriving  during  (3.18)  have  virtual  waiting  time  V2.  Finally,  class 
.42  customers  arriving  during  (3.19)  find  their  class  in  service,  and  hence  also  have  virtual 
waiting  time  V'o.  Thus.  (3.10)  holds  for  /  =  1. 

A  similar  analysis  of  c hiss  B'2  customers  yields  (3.11)  for  ;  =  1.  Finally,  notice  that  each 
station  is  directly  affected  only  by  its  upstream  station.    Hence,  if  we  define  f,+i  =  inf{f  > 

0  :  V'4,(0  =  \',,  \'4  ,_,_i(/)  =  0}  then  our  entire  analysis  holds  for  i  >  1,  except  that  we  take 
Pa  =  Pb  =  0  in  equations  (3.r2)-(3.15),  becau.se  Vji{t)  decreases  at  rate  one,  not  1  -  pj,  for 

1  >  1.  I 

4     Performance  Analysis 

In  this  section,  we  analyze  the  performance*  of  the  oiiginal  tandem  queueing  system.  Recall 
that  two  types  of  sojourn  tiiue  analyses  were  identified  in  the  Introduction:  Transient  and  steady 
state.   The  goal  of  the  transient  analysis  is  to  e"<timate  a  customer's  sojourn  time  conditioned 
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on  the  system  state  at  the  time  of  arrival.  In  our  heavy  traffic  analysis,  we  estimate  the 
normalized  virtual  waiting  time  Z^,  given  the  vector  workload  {V\, . . . ,  V,).  Since  a  customer's 
service  times  are  not  known  at  tlie  time  of  arrival  to  the  system,  the  workload  process  V;  is  not 
actually  observable.  However,  if  we  let  Qj,(t)  denote  the  number  of  class  ji  customers  in  the 
system  at  time  t,  then  in  heavy  traffic  Vi{t)  is  well  approximated  by 


ft         j=r—  +  y^—       for    /  >  0; 

n  Jn     J 


(4.1) 


in  fact,  the  latter  process  converges  weakly  to  the  former  process  in  the  heavy  traffic  limit.  Let 
us  define 

QM{t)+QB^{t) 


L,it) 


/' 


for    t  >  0, 


(4.2) 


which  is  an  observable  process.  Supf)0.se  a  customer  arrives  to  the  system  at  time  /  and  finds 
L,{t)  =  L,  for  i  =  1 K .  If  we  make  the  substitutions  -^  for  Zj,  and  -y^  for  V,  in  equa- 
tions (3.3)  and  (3.7)-(3.11).  then  the  heavy  traffic  parameter  n  cancels  out  of  these  expressions 
and  we  get 


Wji    is  uniformly  distributed  on 
and,  for  ;  =  1 A'  -  1. 


0, 


for   J  =  A.B 


W 


and 


where 


A,i+l  — 


^'B.i  +  l  = 


L,+\  +  jCb,     with  probability    —^  for   j  =  0, 

Lt+i  -  jCfji,     with  probabilitv    — ^-  for   j  =  I, 

L,  +  ]  +  jCai,     with  probability    — ^-r  for  )  =  0, 

111        i 

L,-^.\  —  jC,\,.     with  probability    -^^—^  for  j  =  1, 


Cai  — 


1  -  PA 
and,  for  ;  =  1, . . .  ,  A'  -  1, 

no,  = 


CB^  = 


1  -  PB 


and      Ci  = 


Lx 


+ 


■■  -^Bi 

-  1 

■  ■  -nA, 

-  1 

■  -  n.4» 

-1; 

-,"«, 

-  1, 

Li 

1  -  Pa       1  -  PB 


Cai 


nAi  = 


Cbi 


11,  =  llA,  +  IIB,. 


(4.3) 


(4.4) 


(4.5) 


(4.6) 


(4.7) 


Ca.,+x  =  {n,  -  1)Ca,.      Cb,  +  i  =  {u,-\)Cb,     and     C+i  =  (n,  -  1)C,.  (4.8) 

If  we  let  Tj,  denote  a  random  service  time  for  class  ji  customers  and  let  Sj,(()  be  the  sojourn 
time  of  a  type  j  customer  at  station  (  who  arri\es  to  the  system  at  time  f,  then  we  have  the 
heavy  traffic  estimate  Sj,{t)  =  Tj,  +  H  j,,  where  U'^,  is  given  in  (4.3)-(4.5).  The  sojourn  tune 
in  the  network  for  type  j  customers  is  given  by  Sj(()  =  ^,'^,  Sj,{t). 
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Now  we  estimate  the  steady  state  sojourn  time  Sj,  for  class  ji  under  some  additional  as- 
sumptions. Most  importantly,  we  assume  that  setuj)  times  are  zero.  Peterson  has  shown  that 
(Vi, . . .  .  \X)  hail  product-form  stationary  density 

1  =  1 
where 

as  long  as  the  network  data  satisfy  a  certain  skew-symmetry  condition.  The  skew-symmetry 
condition,  given  by  equation  (62)  of  Peterson,  reduces  in  our  case  to 

-^.4^0  +  ^BCbo  =  Xac^j,,  +  \bCb,  (4.11) 

for  all  ;  =  1, . . .  ,  A'.  A  special  case  of  (4.11)  is  cj,  —  c~  for  j  =  .4.  B  and  ;  =  0 A'  -  1.  which 

is  slightly  less  restrictive  than  the  standard  product  form  conditions  for  .Jackson  networks. 
Of  course  (4.11)  also  allows  for  other  interesting  solutions,  such  as  c^,  =  Cy  J  =  A.B.  /  = 
0, .  . .  ,  A'  -  1,  where  r~^  ^  Cq  is  po.ssihle.  Harrison  and  Williams  (1986)  show  that  the  skew- 
symmetry  condition,  together  with  the  stability  condition  /;,  <  1  for  all  i.  are  necessary  and 
sufficient  for  the  exponential  product-form  solution.  If  skew-synunetry  is  not  satisfied  then  rhe 
numerical  procedure  developed  by  Dai  and  Harrison  (1992)  for  the  stationary  distribution  of 
reflected  Brownian  motion  on  the  orthant  can  l)e  employed  in  conjunction  with  our  deterministic 
analysis  to  estimate  steady  state  sojourn  times.  For  the  remainder  of  this  section,  we  iissume 
that  the  skew-symmetry  condition  holds. 

Since  the  random  variable  Y  =  nX  is  exponential  with  parameter  ^^«"'  if  A'  is  exponential 
with  parameter  u,  heavy  traffic  analysis  preui':ts  that  (Lj , .  . .  ,  Z,/^)  possesses  an  exponential 
product-form  density  with  parameters 

9,                      2(1 -p) 
9,  =  -?=  =  ^ ^ — _.,,  >>     ,     ■-,  .■  (4.12) 

/"  Ej  =  A.B^jf^     -('^jO  +  Cj,) 

Hence,  equations  (4.3)-(4.8)  can  be  combined  with  (4.12)  to  characterize  our  estimate  of  the 
stationary  virtual  waiting  time  U^,,  which  is  independent  of  the  heavy  traffic  parameter  /;.  As 
before.  5^,  =  VI  j,  -|-  Tj,  gives  the  stationary  .sojourn  time  for  class  ji  and  the  stationary  sojourn 
time  for  type  j  is  ^,^i  Sj,. 

Unfortunately,  the  recursive  nature  of  (4.3)-(4.8)  prevents  us  from  explicitly  writing  the 
probability  distribution  for  the  virtual  waiting  time  U  j,.    However,  performance  measures  of 

1.3 


interest  for  Wji,  such  as  tail  probabilities  or  moments,  can  be  computed  by  integrating  with 
respect  to  the  stationary  distribution  of  (Z,i L,).  For  example,  equations  (4.4)-(4.5)  imply 

that 

/rru-         \r  r       ]       r         ,   CB,(nBi(nB,  -  1)  -  n.4,(n^,  -  1)) 

£;U,4,,+i  Li L,+i    =  L,+i  + (4.1J) 

2(n,i,  +  ne,  -  1) 

and 

2(n4, +nB, -1) 
for  J  =  1, . . . ,  A'  -  1.  Hence,  the  steady  state  expected  virtual  waiting  time  for  class  .42  is 


^      ^        ^        Jo     Jo  2(\^^^^^f^]  +  \^^^^^^^] -l) 

91626-"'''' e-'''^'dxidx2.  (4.15) 

Our  results  reveal  several  insights  about  system  behavior.  Expressions  (4.7)-(4.8)  quantify 
exactly  how  the  service  cycles  at  a  station  are  forced  to  synchronize  with  the  service  cycles  at 
its  upstream  neighbor,  and  how  this  effect  ripples  through  the  tandem  network.  Since  n,  >  2 
for  all  ;  by  (4.7),  it  follows  by  (4.8)  that  Cj,  is  nondecv^asing  in  ;  for  j  =  A.B;  that  is,  cycle 
lengths,  and  hence  batch  sizes,  tend  to  be  larger  at  downstream  stations.  Moreover,  ^^  is  the 
same  for  all  i.  so  that  the  cycle  lengths  of  each  customer  type  grow  in  the  same  proportions  as 
one  moves  downstream.  Also,  the  virtual  workload  is  very  different  for  1  >  1  than  for  station 
1:  Zj\  is  uniformly  distributed,  but  Zj,  takes  on  ;),  -  1  distinct  values  for  /  >  1. 

Finally,  notice  that  since  Cj,  increases  with  ;,  the  quantities  n.4,  and  ns,  will  equal  one  with 
greater  frequency  as  i  increases.  Hence,  equations  (4.13)-(4.14)  suggest  that  both  £'[H''.4i]  and 
£^[^Bi]  should  slowly  move  towards  (but  not  necessarily  converge  to)  the  value  6  as  i  increases; 
consequently,  we  conjecture  that  the  imhalmivc  between  fiie  customer  types  dissipates  as  one 
moves  downstream.  Similarly,  by  (4.4)  (4.5),  we  conjectm-e  that  the  variabiJitv  of  the  sfationarv 
sojourn  times  at  each  station  should  be  smaller  at  downstream  stations.  Although  we  have  not 
been  able  to  prove  these  two  conjectures,  they  have  been  borne  out  In-  Monte  Carlo  simulations 
(that  is,  by  generating  random  samples  for  L,)  of  the  recursive  equations  (4.7)-(4.8). 

Let  us  now  focus  on  the  symmetric  case  where  A 4  =  A/j.  Then  iiai  =  "Bi  and  C.\,  =  Cb, 
for  all  i,  and  -fP-  is  an  odd  positive  integer.  Hence,  W,\,  and  Wb,  are  identically  distribut(>(l 
for  any  given  station  (  and  ff^j,]  =  0,"',  whicii  is  equal  to  the  corresponding  quantity  in 
the  heavy  traffic  analysis  of  a  tandem  system  under  the  FCFS  discipline;  of  course,  the  latter 
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Class 

Sojourn  Time 

Sojourn  Time 

Cycle  Length 

Mean 

Standard  Deviation 

Mean 

.41 

10.0(±0.2) 

12.1(±0.3) 

4.73(±0.05) 

.42 

10.1(±0.2) 

11.6(±0.3) 

6.06(±0.07) 

.43 

10.0(±0.1) 

11.2(±0.3) 

6.80(±0.08) 

.44 

10.0(±0.1) 

11.0(±0,2) 

7.25(±0.09) 

A5 

10.1(±0.2) 

10.9(±0.3) 

7.55(±0.09) 

Table  I;  Simulation  results  for  a  sj^mmetric  network. 

quantity  coincides  with  e.xact  results  when  one  further  restricts  all  interarrival  and  service  time 
distributions  to  be  e.xponential.  Furthermore,  by  (4.4)-(4.5).  the  conditional  variance  of  \Vj,,+i 
is  given  by 


\'ar\\\ 


;,-  +  ] 


|Li, . .  .  .  Z-j+i 


_  ^';,'b'('b'  - 1) 


(4.16) 


for  /  =  1 A'  —  1  and  j  =  .4,  B.  To  assess  the  accuracy  of  our  estimates  and  to  corroborate 

the  insights  described  above,  we  display  simulation  results  in  Table  I  for  a  symmetric  tandem 
system  with  A'  =  5  stations.  Setup  times  are  zero,  all  interarrival  times  and  service  times  are 
exponential,  and  the  system  parameters  are  A4  =  \b  =  0.45  and  //  =  1.  Hence.  9,  =  }-^  and 
£•[5^,]  =  10,  which  agrees  with  the  simulation  results  (this  result  can  be  derived  directly  from 
Little's  formula  in  this  special  case).  Eciuation  (4.3)  implies  that  I'arlVV'^u]  =  135  and  hence 
the  estimated  standard  deviation  of  class  .4rs  sojourn  time  is  \/l3Q  =  11.66,  which  is  slightly 
less  than  the  simulated  value  of  12.1  (numbers  in  parenthesis  in  Tables  I  and  II  correspond 
to  95%  confidence  intervals).  Using  (4.16).  we  estimate  the  stationary  sojourn  time  standard 
deviation  for  class  .42  to  be  10.93,  compared  to  the  simulated  value  of  11.6.  In  contrast,  under 
FCFS,  the  variance  of  the  waiting  time  in  queue  is 

(/'  -  A.4  -  Afl)' 
and  so  the  standard  deviation  of  the  sojourn  time  for  (>ach  class  is  10.    .-^s  predicted.  Table 
I  shows  that  cycle  lengths  grow  and  sojourn  time  standard  deviations  decrease  as  one  moves 
downstream. 


Now  let  us  assume  that  A,4  >  A/j.  Then  (4.6)-(4.8)  imply  that  C,.\,  >  Cbx  and  ".ii  >  "Bi 
for  all  I.  Consequently,  by  (4.3)-(4.5),  we  have  i?[Z^,]  <  E[Zbi\  and  \'ar[Z.4,]  <  V«r[ZB,] 
for  all  ;:  that  is,  the  customer  ty])e  with  the  lower  arrival  rate  incurs  both  a  higher  expected 
waiting  time  and  a  more  variable  waiting  time.  This  is  in  contrast  to  a  FCFS  Markovian 
tandem  network,  where  steady  state  waiting  nmes  for  each  type  are  identically  distributed. 
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Station 

Sojourn  Time 

Sojourn  Time 

Mean 

Standard  Deviation 

Type  A           Type  B      , 

Type  A          Type  B 

1 

8.10(±0.07)      14.0(±0.1) 

9.03(±0.12)     18.1(±0.2) 

2 

8.58(±0.07)     13.0(±0.1) 

9.05(±0.12)     16.7(±0.2) 

3 

8.83(±0.08)      12.3(±0.1) 

9.04(±0.12)      15.8(±0.2) 

4 

9.02(±0.07)      12.0(±0.1) 

9.04(±0.12)      15.3(±0.3) 

5 

9.r2(±0.07)      11.7(±0.1) 

9.02(±0.11)      14.9(±0.2) 

Table  II:  Simulation  results  for  an  asymmetric  network. 

We  simulated  a  five-station  example  for  this  case,  where  A^  =  0.6,  A«  =  0.3  and  /./  =  !.  The 
predicted  steady  state  expected  sojourn  times  are  7.75  for  class  .41.  14.5  for  class  Bl.  8.56  for 
class  A2  and  12.51  for  class  B2:  the  iMcdicted  sojourn  time  standard  deviations  are  8.77  for 
class  .41  and  17.46  for  class  Bl  All  six  of  these  quantities  are  reasonably  close  to  the  simulated 
values  found  in  Tal)le  II.  Notice  that  the  results  in  Tables  I  and  II  are  quite  different,  whereas 
the  corresponding  results  under  FCFS  would  be  identical.  Table  II  confirms  the  qualitative 
insights  predicted  by  heavy  traffic  theory;  Type  B  customers  have  higher  sojourn  time  means 
and  variances,  the  difference  in  expected  sojourn  time  between  classes  .4/  and  Bi  decreases  in 
/,  and  standard  deviations  for  type  j5"s  sojourn  times  d'  crease  as  one  moves  downstream. 

5      Generalizations 

In  this  section,  we  investigate  five  generalizations  of  our  basic  model. 
5.1      Unequal  Service  Rates 

Let  us  suppose  that  the  service  rates  at  a  station  differ  by  class,  and  define  //j,  to  l)e  the 
service  rate  for  class  ji  for  _;  =  A,  B  and  ;  =  1,...,A'.  The  main  difference  in  the  analysis 
is  that  V''^,+i(/)  and  Vfi,i+\(f)  are  no  longer  constant  when  Si{t)  =  s,  +  \{t).  Although  a  limit 
cycle  exists  (as  long  as  we  take  p  =  I  m  the  deterministic  analysis)  under  this  generalization, 
the  analysis  is  much  more  complicated  and  we  only  summarize  the  main  results.  A  more 
detailed  statement  of  the  results  (without  derivation  or  proof)  is  presented  in  the  appendix. 
Several  new  definitions  are  required.  Define  the  service  rate  ratios  r,,  =  ''''  for  ;  =  .4,  B  and 
i  =  1, . . . ,  /\  -  1.  It  is  convenient  to  express  our  results  in  terms  of  classes  ki  and  /?,  rather  than 

.4?  and  Bi.  where  a-,  >  1  >  /•/,  for  /  =  1 I\  -  I.  The  first  limit  cycle  at  station  i  >  1  begins 

at  time  (,  =  inf{t  >  0  :  Vk,{t)  =  0,  .s,_i(t)  =  k\s,(t)  -  /}.  Unlike  the  analysis  in  Section  3.  V, 
does  not  stay  constant  on  the  time  scale  of  the  deterministic  analysis,  and  hence  V'(,(^)  does 
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not  necessarily  equal  l',(0)  -  VA.,(f,).  The  limit  cvrle  dynamics  cannot  be  analyzefl  without 
knowledge  of  \'/,(^).  Define  i,  =  inf{/  >  0  :  .s,(/)  y^  ^,(0)}  to  he  the  first  time  server  t  switches 
class.   The  analysis  proceeds  by  recuisively  (leri\iui;  t,.  and  then  developing  an  expression  for 

Vl,(fi)  '•!  terms  of  /,.  Given  V/,(^).  /  =  1 A'  —  1,  the  next  step  is  to  calculate  the  liniil  cycle 

equations  for  1^,(0  and  \'ii(t)  corresponding  to  (3.16)  (3.23).  The  cycle  lengths  C\,  and  C/,. 
and  virtual  waiting  times  Z^,  and  Z/,  can  then  be  obtained.  Define  n/,  =  '■'''"','"'"  .  There 
are  two  different  structures  to  the  limit  cycle  here,  depending  on  whether 

1)   V',,,  +  i(^",  +  i)  -  {n,,  -  l)rk,Ck,  e  (O.Cfc,] 

or 

In  case  1)  class  li  is  exhausted  while  .s,(f)  =  k\  s,^i(t)  =  I,  and  in  Cfise  2)  class  li  is  exhausted 
while  s,(t)  =  .s-,+i(0  =  /.  Note  that  case  2)  cannot  occur  if  r^.,  =  1,  so  this  is  a  phenomenon 
that  does  not  show  up  in  the  ecjual  service  rate  setting. 

When  viewed  on  the  time  scale  wh.ere  the  total  workload  process  changes  (and  individual 
workloads  are  moving  infinitely  (juickly).  this  process  has  a  feature  not  present  in  the  equal 

service  rate  case.    Because  the  total  workload  at  stations  2 A'  may  change  over  the  limit 

cycle,  the  constraint  that  the  total  workload  can  never  go  negative  is  imposed  on  the  minimum 
w'orkload  achieved  over  a  cycle.  As  a  consf»()uence.  the  analysis  of  the  vector  total  workload 
process  must  take  into  account  the  "oscillations"  in  each  station's  total  workload. 

5.2      Multi-Type  Networks 

Another  natural  generalization  to  investigate  is  the  case  of  more  than  two  customer  types. 
The  simplest  example  is  a  perfectly  synnnetric  three-type,  two-station  network;  that  is.  each 
type  has  arrival  rate  A  and  all  six  classes  have  service  rate  //.  As  before,  let  C,  ecjual  the  cycle 
length  at  station  (  and  \',  be  the  normalized  workload  at  station  i,  for  i  =  1,2.  Also,  let  Zi 
denote  the  normalized  virtual  waiting  time  for  any  class  at  station  2,  conditioned  on  I'l  and 
V2.  After  analyzing  numerous  problem  instances,  we  have  the  following  conjecture.  There  are 
two  cases,  depending  upon  wliether 


C, 


-f  >  -      (case  1)  (5.1) 

C  1         3 


or 


C, 


Vo  1 

-^G[0,-)     (case  2) 

Ci  o 


In  case  1,  we  have 


C2=     3 


2    C, 


(5.2) 


(5.3) 


and 


Z2  =   ^ 


3    ^  J     .3 


J    3 


w.p.   (;)[,iifl-2) 


-1 
-1 


for   J  =  0, 
for   J  =  1. 


■4J 


In  case  2, 


and 


Ci 


C, 


1    C, 


(5.4) 


(5.5) 


Zo  =  < 


2Ci 
3 


,2Ci 
./     3 


3 


W.p.     (6[i^l-l) 
w.p.     (6[A.l-l) 


for   J=0 2[ol  -1- 


for   ;=0 2|A^ 


1; 


['.-(fSl-l)^-.^     >v-p.     (6f^l-l)-' 


for   ;  =  1,... 


(5.6) 


In  case  1,  the  three  customer  classes  at  station  2  are  served  hi  contiguous  blocks  of  -^  time 
units.  However,  in  case  2,  each  class  is  served  twice  in  a  cycle,  once  in  the  shorter  subcycle 
described  by  the  first  two  equations  in  (5.6)  and  once  in  the  longer  subcycle  given  by  the  last 
two  equations  of  (.5.6).  There  are  six  blocks  of  service  in  a  cycle,  which  alternate  in  length 
between  c^  K'l  -  i^  <iiid  U^  CV  Since  the  server  location  s,{t)  dictates  the  dynamics  of 
Vj,t+\{f)'  the  complicated  service  process  in  case  2  would  presumably  make  the  analysis  of  a 
third  station  considerably  more  complex. 

5.3      Setup  Times  at  Station  1 

Our  third  generalization  allows  us  to  perform  a  steady  state  analysis  when  setup  times  are 
incurred  at  the  first  station.  The  presence  of  setup  times  alters  the  vector  station-level  workload 
process;  indeed,  with  only  the  first  .station  present,  it  is  sliown  in  CPR  II  that  the  workload 
process  converges  to  a  Bessel  process  in  heavy  traffic.  There  is  no  analogous  heavy  traffic  limit 
theorem  for  the  tandem  network  with  setup  times  in  the  first  station.  A  heinistic  derivation 
of  the  infinitesimal  drift  vector,  along  the  lines  presented  in  CPR  II  yields  //i(x)  =  ^-^^^ "  -  r, 
/i2(x)  =  "P^Pg",  and  ^u(x)  —  0,  2  <  k  <  K,  where  c  =  \/n{l  -  p),  .s  is  the  mean  ,setup  time 


18 


over  a  cycle  (switch  from  .4  to  B  and  from  B  to  .4),  and  x  is  the  workload  vector.  Since  onr 
goal  is  to  obtain  steady  state  performance  measures,  we  assume  that  the  covariauce  matrix 
satisfies  the  skew-symmetry  condition  described  in  Section  4,  so  that  af,  =  2q~',  1  <  ;  <  A', 
and  afj  —  — a~^l{|,_j|=i},  1  <  '  7^  j  <  A',  where  a  =  ii'/[\,\cj^^  +  ^Bcjij-  It  was  shown  by 
Yamada  (1986)  that  for  A'  =  2  a  process  fitting  an  appropriately  completed  version  of  the  above 
description  (including  boundary  behavior)  exists,  and  is  unique  in  distribution.  (It  was  also 
remarked  there  that  the  extension  to  A'  >  2  is  straightforward.)  Yamada  (1986)  also  proves  a 
heavy  traffic  limit  theorem  for  tandem  networks  with  state  dependent  service  rate  that  gives 
some  backing  to  our  Jissumption  here  of  convergence  (especially  in  light  of  the  discussion  in 
CPRII  linking  their  result  to  an  earlier  result  of  Yamada  1984). 

Although  the  existence  of  our  process  is  covered  by  Yamada  (1986),  there  are  no  results 
that  character'ze  the  stationary  distribution  of  the  process.  We  conjecture  that  the  station- 
ary distribution  has  a  product  form,  with  the  first  marginal  a  ganmia  distribution  (obtained 
as  the  stationary  distribution  of  a  one-dimensional  Bessel  process),  and  the  other  marginals 
exponential.  In  particular,  we  conjecture  that 

7r(.ri i-k)  =  ril3+l)' '      ■"■'  ^  0'  1  ^  '■  ^  ^''  ' 

where  f3  =  Xp^pBS. 

The  current  theory  of  multidimensional  diffusion  processes  does  not  provide  a  means  of 
verifying  the  above  conjecture.  One  way  to  lend  it  jilausibility  is  to  derive  (without  proof)  a 
"Basic  Adjoint  Relationship'  (BAR)  for  this  process,  analogous  to  the  one  proven  to  hold  for 
reflected  Brownian  motion  in  an  orthant  by  Hiurison  and  Williams  (1987).  and  show  that  our 
proposed  solution  satisfies  the  BAR.  Rather  than  taking  this  lengthy  detour,  we  merely  point 
out  that  this  program  has  been  carried  out,  and  it  works. 

We  have  restricted  our  attention  to  setup  times  at  the  first  station.  \\'ith  setup  times  at 
other  stations  the  state  dependent  drift  is  extremely  complicated  because  the  A'*'^  component 
of  the  drift  depends  on  the  cycle  time  at  station  A',  which  depends  on  the  workload  at  station 
k  relative  to  station  A  -  1. 

5.4      FCFS  Queues 

Most  manufacturing  systems  have  some  workstations  that  incur  sizeable  .setups  and  other 
workstations  where  setups  are  negligible.  At  the  latter  stations,  FCFS  is  a  commonly  employed 
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queueing  discipline.  In  this  subsection,  we  show  that  our  analysis  can  be  extended  to  a  tandem 
network  that  consists  of  any  combination  of  FCFS  queues  and  polling  queues.  First,  note  that 
a  set  of  product-form  tandem  FCFS  queues  can  be  placed  in  front  of  tlie  network  analyzed  in 
this  paper  without  altering  our  results;  the  Poisson  output  from  the  last  FCFS  queue  preserves 
the  product-form  stationary  distribution. 

Now  suppose  that  in  FCFS  queues  are  appended  to  tlie  end  of  the  network.  Because 
customer  overtaking  cannot  occur,  the  sojourn  Mme  of  all  customers  in  the  FCFS  stations  is 
given  by  the  workload.  Using  the  snapshot  principle,  the  sojourn  time  distribution  can  be 
calculated  from  the  vector  of  station  level  workloads. 

Now  suppose  station  A'  -I-  n?  -I-  1  is  a  polling  queue.    Then  stations  1 A'  -I-  in  affect 

{^ j.K+m+i{t)J  >  0}  only  through  the  server  location  process  Sf(+rn{t)-  Although  we  omit  the 
details,  Theorem  1  can  be  applied  directly  to  analyze  station  A'  -I-  m  -I- 1 ;  that  is,  equations  (3.8)- 
(3.11)  hold  for  ;  =  A  -I-  in.  To  prove  this  fact  one  only  needs  to  verify  that  f^'+m+i  =  inf{^  > 
0  :  \'4  /v+„,(/)  =  I  A+,n,  \'.j /^•_^,„^i(/)  =  0}  is  reached  within  a  finite  amount  of  time. 

5.5      Closed  networks 

Suppose  that  customers  exiting  station  A  immediately  return  to  station  1,  thereby  gen- 
erating a  closed  cyclic  network.  Although  customers  never  enter  or  leave  this  network,  in  a 
manufacturing  context  where  each  customer  represents  a  "job",  it  is  useful  to  think  in  terms  of 
replacing  a  completed  job  that  (>xits  station  A  with  a  new  job  that  enters  station  1.  Readers 
are  referred  to  Dai  and  Harrison  (1993)  for  an  extensive  discussion  of  multidass  closed  queueing 
network  models  for  manufacturing  systems. 

Two  types  of  closed  networks  can  be  formulated,  depending  upon  the  nature  in  which 
customers  or  jobs  are  injected  back  into  the  system.  If  a  job  departing  station  A'  does  not  change 
type  when  it  returns  to  station  1  then  we  have  a  multichain  network,  where  the  population  size  of 
each  customer  type  remains  constant.  If  the  customer  type  of  each  reinjected  job  is  exogenously 
prespecified  (in  a  deterministic  or  probabilistic  fa.shion)  then  a  single-chain  network  is  obtained; 
in  the  latter  case,  the  total  population  size  is  fixed  l)ut  the  nunil)er  of  ctistomers  in  the  network 
of  each  type  may  fluctuate  over  time.  Manufacturing  system  managers  need  to  ensure  that  the 
otitput  mix  of  job  types  equals  the  exogenous  demand  mix.  The  most  <iirect  and  reliable  way 
to  guarantee  this  match  between  the  desired  mix  and  the  realized  mix  is  to  use  a  single-chain 
network  where  the  mix  of  entering  jobs  equals  the  exogenous  product  mix;  see  Harrison  and 
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Weill  (1990)  for  further  discussion  on  this  point. 

Consecjuently,  we  focus  on  tlie  single-cliain  torniulafion.  Let  us  alter  the  ba.sic  uiodel  in 
Section  2  i)y  (iisaliovving  exogenous  arrivals  and  maintaining  a  fixed  population  size  of  A'  cus- 
tomers. \\e  assume  that  the  long  run  pr()])ortiou  of  exiting  jobs  that  are  reinjected  as  type 
J  customers  is  c/j,  where  (7.4  +  ga  =  1.  Also  assume  that  the  service  time  distributions  are 
associated  with  each  station  rather  than  each  class,  so  that  the  .stiuared  coefficients  of  variation 
satisfy  r^,  =  cj^^  for  ;  =  1 A'. 

Recall  that  in  the  deterministic  analysis  of  the  open  queueing  network  in  Section  3.  type 
J  work  arrives  to  station  1  at  the  constant  rate  pj.  for  j  =  .4,/?.  Observe  that  in  a  similar 
deterministic  analysis  of  this  closed  network,  station  1  receives  type  j  work  at  a  steady  rate 
of  Qj  for  J  =  A,B:  furthermore,  the  interactions  l)etween  stations  i  and  i  +  1  are  identical  in 

the  open  and  i  losed  networks  for  1  =  1 A'  —  1.    Hence,  the  results  in  Section  3.  namely 

eciuations  (3.3).  (3.-5),  (3.6)  and  (3.8)  (3.11).  all  hold  for  the  closed  cyclic  network  with  pj 
replaced  l)y  r/,  for  j  =  A.B.  Moreover,  the  closed  network  results  may  be  more  robust  (with 
respect  to  the  heavy  traffic  assumptions)  tiian  the  open  network  results  because  q^  +  qij  =  1. 
whereas  we  needed  to  assume  that  p:^  +  p^  =  1  in  the  open  network  analysis.  The  results  on 
unequal  service  rates  do  not  carry  over  to  the  closed  network  case  because  the  imequal  service 
rates  lead  to  a  fluctuating  arri\al  rate  of  work  at  station  1  (depending  upon  which  customer 
type  is  being  serv'ed  at  station  A)  of  the  closed  network. 

If  we  further  assume  that  setup  times  are  zero  and  all  A  service  time  distributions  have 
identical  sciuared  coefficients  of  variation,  then  the  steady  state  heavy  traffic  analysis  yields 
remarkably  simple  results,  as  shown  in  Section  11  of  Dai  and  Harri.son  (1993V  The  throughptit 
rate  of  our  network  is  identical  to  the  throughput  rate  of  the  FCFS  network  considered  by 
Dai  and  Harri.son  (1993).  and  is  given  by  eciuation  (11.2)  of  their  paper.  Their  approximating 

heavy  traffic  analysis  implies  that  the  stationary  workload  process  [L\ L^-)  is  uniformly 

distributed  on  the  simplex  {.r  €  /?^  :  Ylk=\-'^k  =  /'"'-"^  }■  This  result  holds  regardless  of  the 
values  of  f/j  and  the  precise  nature  (i.e..  deterministic  or  random)  of  the  reinjection  mechanism. 
Moreover,  this  result  holds  for  A'  =  2  stations  even  if  the  s(iuar(>d  coefficients  of  variation  differ 
at  the  various  stations.  For  the  two-station  case  (whose  analysis  reduces  to  reflected  Brownian 
motion  on  the  interval  [0.//"'],  the  virtual  waiting  time  (listril)\ition  at  station  1  is  given  by 

f    ^  [l  +  h.f-^)]     for   0</<i^ 
1  for  ^  >  -^  . 
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We  also  obtain  £'[Vl''ji]  =  ^-^  and  V'ar[iyji]  =  y^^^-    If  in  addition  q,\  =  r/B  =  k-  th™ 


E[Wji]  =  E[Wj2]  =  g  and  by  (4.16), 


Var\\Vj, 


3  U  /       Jo 


[f-l 

/ 

f 

2x 

\ 

2x 

1  \dx 


87V^  ^  A?(n-l)(12/r'  +  l) 


9/|2    IZ 


(4n2 


1) 


(5.8) 
(5.9) 


Calculation  of  the  covarianco  of  W'ji  and  Wj)  lead'  to  the  varianre  for  the  .steady  state  sojourn 
time  of  a  type  j  customer,  which  is 


N'^        m^^  11(71-  l)(12»^  +  l)       jcji  +  c]^) 


(5.10) 


In  contrast,  under  FCFS.  the  corresponding  heavy  traffic  approximation  for  the  variance  of  the 

V- 

virtual  waiting  time  at  each  station  is  only  p^-^  and  the  variance  of  the  total  sojourn  time  at 
both  stations  is  simply  ■''  V'^^  (due  to  the  snapshot  prin(i])le  and  the  deterministic  relationship 
between  workloads  and  queire  lengths). 

Finally,  let  us  consider  the  two-station  cyclic  network  with  s(>tup  times.  The  analysis  in 
CPRII  suggests  that  the  normalized  station  1  workload  V'l  is  a  Bessel  process  on  the  interval 
[0,^~^]  with  instantaneous  reflection,  drift  r(.r)  =  24lBi^  j^,^(j  variance  a^  =  /'""(c"^i+Cj2)-  where 
the  total  population  size  is  ;V  =  s/n.  From  stantlard  results  on  the  stationary  distribution  of 
one-dimensional  diffusions  (c.f.  Mandl  1968  or  Karlin  and  Taylor  1981).  the  stationary  density 
of  this  process  solves  the  ordinary  differential  ('([uatiou 


d^TT 


■2  rfx2^^"^  "  j^M-{2-M-i-))  =0.      0  <  .r  <  l//i 


with  boundary  conditions 


and  normalization  condition 


a^  d-K  .    .         /    ,    ,    ,  1 

—  —  (x)  =  c(.r)7r(x),      X  =  0,  - 

1  ax  fjL 


L 


l/A- 


The  solution  of  (5.11)   (5.13)  is 


7r(x)  = 


2a2 


T\{x)dx  =  1 


,.x  5/2^2 


(5.11) 


(5.12) 


(5.13) 


0  <  X  <  /J 


-1 


(2a2-h,s)//  V//. 
Note  that  if  s  =  0  (zero  setup  times)  this  reduces  to  a  miiform  density. 


■->•'> 


6     Concluding  Remarks 

Fi^oiii  tli(^  viewpoint  of  manufacturing  systems  aj^plications,  the  biggest  shortcoming  in 
queueing  network  theory  is  umiouhtediy  the  faihuc  to  incorporate  setu[)  times.  In  tliis  pa- 
per we  make  a  modest  att(Mni)t  at  addressing  this  shortcoming  by  analyzing  the  j)erformance  of 
a  set  of  i)oning  systems  in  tandem.  By  exploiting  the  time  scale  deconii)osition  inherent  in  the 
heavy  traffic  analysis  of  polling  systems,  we  derive  sojotun  time  estimates  for  both  the  transient 
and  steady  state  cases.  The  simple  form  of  Theorem  1  allows  us  to  gain  some  understanding  of 
the  l)ehavior  of  these  com])lex  systtnns.  In  i)articular,  as  one  moves  from  upstream  stations  to 
downstream  stations,  the  batch  sizes  tend  to  get  larger,  the  imbalance  t^etween  customer  types 
becomes  less  pronounced  and  the  varialjility  of  sojourn  times  is  reduced.  However,  our  analysis 
in  Sections  5.1  and  5.2  suggests  that  results  for  the  general  multi-type,  multi-station  tandem 
network  will  not  come  easily. 
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Appendix 

In  this  appendix  wo  jnovide  some  more  details  of  the  analysis  of  the  unequal  service  rates 
case,  considered  in  Section  5.1.  For  the  sake  of  brevity  we  only  state  results,  omitting  derivations 
and  proofs. 

The  first  step  in  the  analysis  is  a  recursive  determination  of  i,,  from  which  an  expression 
for  \]i{it)  can  be  obtained.  In  particular,  ii, . . . .  i/^-i  are  defined  by 


t]    —  T—     It      s 

1  -  ^ 


{0)^j    for   j  =  A.B. 


(A.l) 


and  for  (  =  1 A'  —  2, 


*.+l  =  V't  ,+  i(0)  +  r^,f,  +     max  I  1, 
if   .s,(0)  =  .s,+,(0)  =  A-: 


-  1     ik.Ck, 


:a.2) 


/,+i  =  Vi.,,+  i(0)  + 


vi.,,+i(0)-f, +  (a., -i)c,, 


'•i,Ci, 


if   ,s,(0)  =  /    and   .s,+i(0)  =  k; 


{Vt,.+i(0)>/,}      ^|Vi.,+,(0)<(",)  +  M  ''k'C'ki 

(A.3) 


i,+i  =  V,,,+  i(0)  +  (m^.,  +  l)n,0,    if   .s,(0)  =  A-,.s,+,(0)  =  / 

and    \;.,+  i(0)  -  /,  +  (/■/,  -  1)C/,  -  "u.,a.,Q,  €  (-oo/{„,^_^_i},  O.,], 


(A.4) 


where 


'"/c!    = 


V;,+i(0)-f, +  (n, -1)0, 


^{i,,,+,(0)>(,-(n,-i)O,}      ^(r,,,  +  i(0)<f",-(r,,-i)C,.}-      (A-a) 


f,  +  ,   =  <,  +  (777J..  +  1)C,  +  (r;,  -  1)-'[^"U.  +  l)a-,a.,  +  /',  -  \',,,  +  ,(0)] 

if    ^,(0)-A-,s,+  ,(0)  =  /    and    \';,,+  i(0)  -  f,  +  (r,,  -  1)C,,  -  "U-.'l-.a.,  €  (Q.,,  a-.a,]: 

f,  +  i  =  Vi.,  +  i(0)  +  /•„/,  +  mi.n.Ci,    if    .s-,(0)  =  .s,  +  i(0)  =  / 
and    \i,,  +  i(0)  +  (/•,,  -  1)/,  -  /n,,a,,CV-,  €  (O.C/t,], 


where 


and 


771,,   = 


rk.Ck, 


^{11..  +  ! 


(0)>(l-r,,)f,}         ^{Vl,.  +  ,(0)<(l-r,,)(,] 


(A.6) 


(A.7) 


(A.8) 
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h+i  =  mi,C,  +  C\,  +  (r,,  -  l)-'[r»;,a.,a.,  +  C\.,  -  V,,,+,(0)]    if   s,(0)  =  ,s,+,(0)  =  / 
and    V;,,+i(0)  +  (r/,  -  l)i,  -  m/,.,r;t,Q-,.  e  (O,  -  oci/{,„,^  =  _,|,  a.,Cfc,]. 

The  quantities  V;2(f-2) ^'//\'(^/\')  ^rt'  given  by 

i/,,+i(^+,)  =  v;+i(0)  +  in,  -  iji,  +  (n,  -  i)Ci,  if  ^,(0)  =  A- 


(A.9) 


(A.  10) 


and 


\i,+i(i,+i)  =  v;+i(o)  +  (n,  -  i)f,  if  ^,(0)  =  / 


(A.u) 


for  /  =  1 A'  -  1.    Notice  that,  as  expected,  Vi,+i{f,+i)  =  V',+i(0)  if  rt,  =  n,  =  1.    With 

the  vector  of  \]i(t,)'s  in  hand,  we  can  calculate  the  limit  cycle  ecjuations  for  Vk,(t)  and  Vi,(f) 
corresponding  to  (3.16)-(3.23)  (they  will  not  be  written  out  here),  and  then  derive  the  cycle 
lengths  O-,  and  Ci,  and  virtual  waiting  times  Z^.,  and  Z/,  a.s  in  Section  3.  Define 


«;,  = 


^"/,i+i(^-n) 


and    Ilk,  = 


ri,Ci, 


(A.  12) 


There  are  two  possible  limit  cycles:  In  ca^se  1,  l';,  +  i(f,+i)  —  (n;,  —  l)7'A:,Cfc,  6  (0,  C\.,]  and 
class  1,1  +  1  is  exhausted  while  .s,(?)  =  A-,.s,+i(^)  =  /.  In  case  2,  V;,  +  i(r,+i)  —  (n;,  —  l)i\;Cki  € 
[Cki,  rkiC'ki]  and  class  /,  /  +  1  is  exhausted  while  .s,(/)  =  s,  +  i{t)  =  I.  Let  U[a,b]  denote  a  uniform 
random  variable  on  the  interval  [«,  6],  and  let  "w.p."  be  shorthand  for  "witli  probability".  Under 
case  1,  our  results  corresponding  to  Theorem  1  are  as  follows:  For  i  =  I A'  —  1. 


Cfc,,+i  =  (n/,  -  1)C,  +  ni,,ri;,Ci„  -  ir>t,  -  l)r,,C/,, 

Ci,,+\  =  nk,Cr  +  {ni,  -  \)ri,Ch  -  >n,rkjCkt. 

Ci+i  =  (lu-i  +  nu  -  1)C',, 

1 


Zi<.,+\  =  {i-k,  -  l)U[i).Ci„]  +  r,,,,i(/,4.i)  -  jri,C,,    w.p. 


1 


(A. 13) 

(A.14) 
(A.15) 


Zk^t+l  =  {rk,  -  l)U[OX'k,]  +  \'tj  +  i{U+i)+ jri,Ci,    w.p.    ■ for   ^'  =  1 n,,  -  1, 

in,  +  n,,  -  1 

(A.16) 
for   J  -  \ nk,  -  1. 


Zk.,+i  =  {rk,-l)U[O.Vi,,  +  i{t,  +  i)-(n,,-l)rk,Ck,]  +  Vu^i{J,^i)  w.p 


Ilk,  +  "h  -  1 

(A.17) 

V',,,+i(f,+i)  -  {ni,  -  l)rk,Ck, 


(nt,  +  n/,  -  l)Ck, 

(A.18) 
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Zk.r+i  =  i'-k,  -  l)C-[0,  [ni,  -  l)rk,Ck,  +  Q.,  -  V',,,+, (/,  +  ,)]  +  a.,V',,,+,(<,+i)  +  rk.ini,  -  l){r,,  -  1)C,, 


w.p. 


{nk,  +  ni,  -  l)Ckt 


Zl.i  +  i  =  (n, -l)t'[0,  C;,]  +  V',,,+i(f,+i)-Cfc,-7rfc,0.,    w.p. 


1 


Zi,,+i  =  (/•/,  -  1)L'[0,C/,]  +  V',,,+i(^,+i)  -  Ck,  +jrk,Ck,    w.p. 


'U-t  +  nu  -  1 
1 


rik,  +  "i,  -  1 
Z,,,+,  =  in,  -  l)U[O.Ci,  +  \i,+iii,+i)  -  nk,ri,Cu]  +  V/,,+, (/,+,)  +  (rt,  -  1)Q.. 


(A.19) 

for  J  =0 nu  -  2, 

(A.20) 
for   J  =  2 Ill;,, 

(A.21) 


w.p. 


Cu  +  V/.,+i(^+i)  -  nk,ri,Ci, 


(A.22) 


and 


Zi,,+i  =  {ri,  -  1)C'[0,  nt,n,C/,  -  V',,,+  i(/,+i)]  +  r/,V;,,+i(/,+i)  -  (r,,  -  \)nk,ruCu 

'U-,r/,C/,-\ -,,,+,  (/",+,)  (A-23) 

Notice  that    (A. 13)   (A. 23)  ri'ducc  to  Thoorcm  1  if  /-t,  =  r/j  for  /  =  !,...,  A'  —  1. 
For  case  2.  we  have,  for  ?  =  1 A'  —  1, 


Ck,,+i  =  {rik,  +  ni,)rk,Ckt, 


Q,i+i  =  ('U-,  +  ni,)ruCu, 


C.-i-i  =  (ilk,  +  nt,)C,, 
Zk,+  i  =  (r;.,  -  l)r[0,a,]  +  (n,  -  l)-'[n,,r,,a.,  -  \',,,  +  ,(^  +  i)]  -  jr,,C,, 
1 


w.p. 


'U-.  +  "/, 


for    J  =  0 in,  +  III,  -  1, 


(A.24) 

(A.25) 
(A.26) 

(A. 27) 


Zi,,+i  =  (n,  -  i)c/[o,  C/,]  +  I ■/,,+! (^+i)  -  Ck,  -  ji-k.Ck,  w.p. 


1 


Ilk,  +  III, 


for   J  =0 II,,  -  2, 


Z,,,+,  =  in,  -  l)f'[0.O,]  +  ^,+^{t,  +  ^)  -  Ck,  +  {rik,  -  j)rk.Ck, 
1 


w.p. 


>ik,  +  "/, 


for   J  =0 Ilk, 


(A.28) 
(A.29) 


Zi,r+i  =  (r,,  -  l)L'[0,n,,C,  -  (r,,  -  1)    '[n/,r/,C/,.,  -  V,.,+i(f,  +  i)]]  +  {iik,  +  n,,)rfc,C/,, 

ni.C,  -  (n.  -  ir'[ii,,n,Ck,  -  V;..^i(f,+i)]  (^-30) 


w.p. 


(ilk,  +  ni,)Ci, 
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Zi, 


+1 


-("/,-  l)'-;-,G, -a-,  (A.31) 

('7,  -  l)~'[n/,n,0-,  -  V',,,+  i(^+i)]  -  [ni,  -  \)C\  -  Ck, 


w.p. 


("A-,  +  "(l)^! 


z, 


l.l+\     = 


(;•„  -  l)f '[0,  (a,  -  DC,,  -  (n,,  +  /^/,  -  D'-;,0,  +  ('7,  -  D^'["hr,,C,,  -  V,,,+  i(<,+i)]] 
+  V',,,  +  i(r,  +  i)  +  (r,,-DC,,  (A.32) 

r,,  -  DC,  -  (ru-,  +  77,,  -  D'7,0,  +  {vki  -  D"M"7;'V,C(t,  -  V^,,,+i(<,+  i)] 


w.p 


("fc,  +  riu)Cu 


and 
Zi.,  +  \     = 


(/■/,  -  Df'[0,  (7(,,  +  ni,)ri,Ci,  -  (7-/,  -  l)'^[ni,ri,Ck,  -  \'i_,  +  i{f,^i)]] 
+  'l,[{in;  +  ni,)ri,Ch  -  'H-X\,] 

(>H;  +  ni,)ri,Ci,  -  {'1,  -  l)~'^[n,,ri,Ck,  -  Vi,,+i(t,  +  i)] 


W.[). 


('It,,  +  >ii,)Ci, 


(A.33) 
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